Mobile terminal and controlling method thereof

ABSTRACT

A mobile terminal and controlling method thereof are disclosed, by which image data of a counterpart having triggered an event can be displayed. The present invention may include a display unit configured to display information, a wireless communication unit configured to communicate with an external server that stores first image data and to communicate with a counterpart terminal, a memory to store a second image data, and a controller, in response to an event triggered by the counterpart terminal, to extract an image data related to a counterpart from one of the first image data and the second image data, and the controller to output the extracted image data on a portion of the display unit to notify an occurrence of the event.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation Application of U.S. application Ser.No. 15/633,215, filed Jun. 26, 2017, which is a Continuation Applicationof U.S. patent application Ser. No. 14/464,768, filed Aug. 21, 2014 (nowU.S. Pat. No. 9,723,124, issued Aug. 1, 2017), which claims priorityunder 35 U.S.C. § 119 to Korean Application No. 10-2013-0107930 filed onSep. 9, 2013, whose entire disclosures are hereby incorporated byreference.

BACKGROUND 1. Field

The present invention relates to a mobile terminal, and moreparticularly, to a mobile terminal and controlling method thereof.Although the present invention is suitable for a wide scope ofapplications, it is particularly suitable for automatically outputtingan image of a counterpart having an occurrence of an event.

2. Background

A mobile terminal is a device which may be configured to perform variousfunctions. Examples of such functions include data and voicecommunications, capturing images and video via a camera, recordingaudio, playing music files and outputting music via a speaker system,and displaying images and video on a display.

Generally, terminals can be classified into mobile terminals andstationary terminals according to a presence or non-presence ofmobility. And, the mobile terminals can be further classified intohandheld terminals and vehicle mount terminals according to availabilityfor hand-carry.

There are ongoing efforts to support and increase the functionality ofmobile terminals. Such efforts include software and hardwareimprovements, as well as changes and improvements in the structuralcomponents which form the mobile terminal.

When a mobile terminal receives a text message or has an incoming call,the mobile terminal is able to output an information on the receivedtext message or an information on the counterpart of the incoming calltogether with such feedback as vibration, sound and the like. In doingso, if a text message is sent or a profile photo of the counterpart ofthe incoming call is registered in a phonebook, the profile photo of thecounterpart can be displayed on the mobile terminal as well.

Thus, in order to output a profile photo of a counterpart of an incomingcall or a profile photo of a counterpart having sent a text message inresponse to each incoming call or a reception of a text message, theprofile photo of the corresponding counterpart should be registered in aphonebook in advance.

However, in order to register a profile photo of a counterpart in aphonebook, there is limitation such that a photo of the counterpartshould be saved in a mobile terminal. And, it is inconvenient for a userto select the profile photo of the counterpart from images saved in themobile terminal. Moreover, if there are many counterparts registered ina phonebook, it requires persistent efforts to register profile photosof all counterparts. Due to the above-mentioned inconvenience anddifficulty, it frequently happens that profile photos are not registeredin a mobile terminal mostly.

Furthermore, even if a profile photo of a counterpart is registered,since the number of a profile photo registrable is 1, the same photo ofthe counterpart is outputted despite multiple occurrences of events.Thus, a user is forced to view the same counterpart photo every time.

BRIEF DESCRIPTION OF THE DRAWINGS

The embodiments will be described in detail with reference to thefollowing drawings in which like reference numerals refer to likeelements wherein:

FIG. 1 is a block diagram of a mobile terminal according to oneembodiment of the present invention;

FIG. 2 is a front perspective diagram of a mobile terminal according toone embodiment of the present invention;

FIG. 3 is a rear perspective diagram of a mobile terminal according toone embodiment of the present invention;

FIG. 4 is a flowchart for an operation of a mobile terminal according tothe present invention;

FIG. 5 is a diagram to describe one example of outputting an image datarelated to a prescribed counterpart to a display unit in response to anoccurrence of an event;

FIG. 6 is a diagram to describe one example of displaying an image datalist;

FIG. 7 is a diagram to describe one example of displaying locationinformation;

FIG. 8 is a diagram to describe one example of outputting an image dataof a counterpart to an event occurrence list;

FIG. 9 is a diagram to describe one example of setting an image data asa background in case of checking event details;

FIG. 10 is a diagram for one example of outputting a new image data inresponse to each occurrence of an event by a prescribed counterpart;

FIG. 11 is a diagram for one example of adjusting a type of an imagedata related to a prescribed counterpart depending on a setup value of amobile terminal;

FIG. 12 is a diagram for one example of adjusting a type of an imagedata related to a prescribed counterpart depending on a type of anoccurring event;

FIG. 13 is a diagram for one example of outputting a different imagedata per time slot;

FIG. 14 is a diagram for one example of outputting a fake data;

FIG. 15 is a diagram for another example of outputting a fake data;

FIG. 16 and FIG. 17 are diagrams for examples to describe a changedphase of a data outputted through a display unit;

FIG. 18 is a diagram to describe an output of a display unit dependingon a level of friendliness with a counterpart; and

FIG. 19 and FIG. 20 are diagrams to describe examples of outputtingsupplementary data.

DETAILED DESCRIPTION

In the following detailed description, reference is made to theaccompanying drawing figures which form a part hereof, and which show byway of illustration specific embodiments of the invention. It is to beunderstood by those of ordinary skill in this technological field thatother embodiments may be utilized, and structural, electrical, as wellas procedural changes may be made without departing from the scope ofthe present invention. Wherever possible, the same reference numberswill be used throughout the drawings to refer to the same or similarparts.

As used herein, the suffixes ‘module’, ‘unit’ and ‘part’ are used forelements in order to facilitate the disclosure only. Therefore,significant meanings or roles are not given to the suffixes themselvesand it is understood that the ‘module’, ‘unit’ and ‘part’ can be usedtogether or interchangeably.

The present invention can be applicable to a various types of mobileterminals. Examples of such terminals include mobile phones, userequipments, smart phones, digital broadcast receivers, personal digitalassistants, laptop computers, portable multimedia players (PMP),navigators and the like.

Yet, it is apparent to those skilled in the art that a configurationaccording to an embodiment disclosed in this specification is applicableto such a fixed terminal as a digital TV, a desktop computer and thelike as well as a mobile terminal.

FIG. 1 is a block diagram of a mobile terminal 100 in accordance with anembodiment of the present invention. FIG. 1 shows the mobile terminal100 according to one embodiment of the present invention includes awireless communication unit 110, an A/V (audio/video) input unit 120, auser input unit 130, a sensing unit 140, an output unit 150, a memory160, an interface unit 170, a controller 180, a power supply unit 190and the like. FIG. 1 shows the mobile terminal 100 having variouscomponents, but it is understood that implementing all of theillustrated components is not a requirement. Greater or fewer componentsmay alternatively be implemented.

In the following description, the above elements of the mobile terminal100 are explained in sequence.

First of all, the wireless communication unit 110 typically includes oneor more components which permits wireless communication between themobile terminal 100 and a wireless communication system or networkwithin which the mobile terminal 100 is located. For instance, thewireless communication unit 110 can include a broadcast receiving module111, a mobile communication module 112, a wireless internet module 113,a short-range communication module 114, a position-location module 115and the like.

The broadcast receiving module 111 receives a broadcast signal and/orbroadcast associated information from an external broadcast managingserver via a broadcast channel. The broadcast channel may include asatellite channel and a terrestrial channel. At least two broadcastreceiving modules 111 can be provided to the mobile terminal 100 inpursuit of simultaneous receptions of at least two broadcast channels orbroadcast channel switching facilitation.

The broadcast managing server generally refers to a server whichgenerates and transmits a broadcast signal and/or broadcast associatedinformation or a server which is provided with a previously generatedbroadcast signal and/or broadcast associated information and thentransmits the provided signal or information to a terminal. Thebroadcast signal may be implemented as a TV broadcast signal, a radiobroadcast signal, and a data broadcast signal, among others. If desired,the broadcast signal may further include a broadcast signal combinedwith a TV or radio broadcast signal.

The broadcast associated information includes information associatedwith a broadcast channel, a broadcast program, a broadcast serviceprovider, etc. And, the broadcast associated information can be providedvia a mobile communication network. In this case, the broadcastassociated information can be received by the mobile communicationmodule 112.

The broadcast associated information can be implemented in variousforms. For instance, broadcast associated information may include anelectronic program guide (EPG) of digital multimedia broadcasting (DMB)and electronic service guide (ESG) of digital video broadcast-handheld(DVB-H).

The broadcast receiving module 111 may be configured to receivebroadcast signals transmitted from various types of broadcast systems.By non-limiting example, such broadcasting systems include digitalmultimedia broadcasting-terrestrial (DMB-T), digital multimediabroadcasting-satellite (DMB-S), digital video broadcast-handheld(DVB-H), Convergence of Broadcasting and Mobile Service (DVB-CBMS), OpenMobile Alliance-BroadCAST (OMA-BCAST), China Multimedia MobileBroadcasting (CMMB), Mobile Broadcasting Business Management System(MBBMS), the data broadcasting system known as media forward link only(MediaFLO®) and integrated services digital broadcast-terrestrial(ISDB-T). Optionally, the broadcast receiving module 111 can beconfigured suitable for other broadcasting systems as well as theabove-explained digital broadcasting systems.

The broadcast signal and/or broadcast associated information received bythe broadcast receiving module 111 may be stored in a suitable device,such as a memory 160.

The mobile communication module 112 transmits/receives wireless signalsto/from one or more network entities (e.g., base station, externalterminal, server, etc.) via a mobile network such as GSM (Global Systemfor Mobile communications), CDMA (Code Division Multiple Access), WCDMA(Wideband CDMA) and so on. Such wireless signals may represent audio,video, and data according to text/multimedia message transceivings,among others.

The wireless internet module 113 supports Internet access for the mobileterminal 100. This module may be internally or externally coupled to themobile terminal 100. In this case, the wireless Internet technology caninclude WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax(World Interoperability for Microwave Access), HSDPA (High SpeedDownlink Packet Access), GSM, CDMA, WCDMA, LTE (Long Term Evolution)etc.

Wireless internet access by Wibro, HSPDA, GSM, CDMA, WCDMA, LTE or thelike is achieved via a mobile communication network. In this aspect, thewireless internet module 113 configured to perform the wireless internetaccess via the mobile communication network can be understood as a sortof the mobile communication module 112.

The short-range communication module 114 facilitates relativelyshort-range communications. Suitable technologies for implementing thismodule include radio frequency identification (RFID), infrared dataassociation (IrDA), ultra-wideband (UWB), as well at the networkingtechnologies commonly referred to as Bluetooth and ZigBee, to name afew.

The position-location module 115 identifies or otherwise obtains thelocation of the mobile terminal 100. If desired, this module may beimplemented with a global positioning system (GPS) module. According tothe current technology, the GPS module 115 is able to preciselycalculate current 3-dimensional position information based on at leastone of longitude, latitude and altitude and direction (or orientation)by calculating distance information and precise time information from atleast three satellites and then applying triangulation to the calculatedinformation. Currently, location and time informations are calculatedusing three satellites, and errors of the calculated location positionand time informations are then amended using another satellite. Besides,the GPS module 115 is able to calculate speed information bycontinuously calculating a real-time current location.

Referring to FIG. 1, the audio/video (A/V) input unit 120 is configuredto provide audio or video signal input to the mobile terminal 100. Asshown, the A/V input unit 120 includes a camera 121 and a microphone122. The camera 121 receives and processes image frames of stillpictures or video, which are obtained by an image sensor in a video callmode or a photographing mode. And, the processed image frames can bedisplayed on the display 151.

The image frames processed by the camera 121 can be stored in the memory160 or can be externally transmitted via the wireless communication unit110. Optionally, at least two cameras 121 can be provided to the mobileterminal 100 according to environment of usage.

The microphone 122 receives an external audio signal while the portabledevice is in a particular mode, such as phone call mode, recording modeand voice recognition. This audio signal is processed and converted intoelectric audio data. The processed audio data is transformed into aformat transmittable to a mobile communication base station via themobile communication module 112 in case of a call mode. The microphone122 typically includes assorted noise removing algorithms to removenoise generated in the course of receiving the external audio signal.

The user input unit 130 generates input data responsive to usermanipulation of an associated input device or devices. Examples of suchdevices include a button 136 provided to front/rear/lateral side of themobile terminal 100 and a touch sensor (constant pressure/electrostatic)137 and may further include a key pad, a dome switch, a jog wheel, a jogswitch and the like [not shown in the drawing].

The sensing unit 140 provides sensing signals for controlling operationsof the mobile terminal 100 using status measurements of various aspectsof the mobile terminal. For instance, the sensing unit 140 may detect anopen/close status of the mobile terminal 100, relative positioning ofcomponents (e.g., a display and keypad) of the mobile terminal 100, achange of position of the mobile terminal 100 or a component of themobile terminal 100, a presence or absence of user contact with themobile terminal 100, orientation or acceleration/deceleration of themobile terminal 100. By non-limiting example, such sensing unit 140include, gyro sensor, accelerate sensor, geomagnetic sensor.

As an example, consider the mobile terminal 100 being configured as aslide-type mobile terminal. In this configuration, the sensing unit 140may sense whether a sliding portion of the mobile terminal is open orclosed. Other examples include the sensing unit 140 sensing the presenceor absence of power provided by the power supply 190, the presence orabsence of a coupling or other connection between the interface unit 170and an external device. And, the sensing unit 140 can include aproximity sensor 141.

The output unit 150 generates outputs relevant to the senses of sight,hearing, touch and the like. And, the output unit 150 includes thedisplay 151, an audio output module 152, an alarm unit 153, and a hapticmodule 154 and the like.

The display 151 is typically implemented to visually display (output)information associated with the mobile terminal 100. For instance, ifthe mobile terminal is operating in a phone call mode, the display willgenerally provide a user interface (UI) or graphical user interface(GUI) which includes information associated with placing, conducting,and terminating a phone call. As another example, if the mobile terminal100 is in a video call mode or a photographing mode, the display 151 mayadditionally or alternatively display images which are associated withthese modes, the UI or the GUI.

The display module 151 may be implemented using known displaytechnologies including, for example, a liquid crystal display (LCD), athin film transistor-liquid crystal display (TFT-LCD), an organiclight-emitting diode display (OLED), a flexible display and athree-dimensional display. The mobile terminal 100 may include one ormore of such displays.

Some of the above displays can be implemented in a transparent oroptical transmittive type, which can be named a transparent display. Asa representative example for the transparent display, there is TOLED(transparent OLED) or the like. A rear configuration of the display 151can be implemented in the optical transmittive type as well. In thisconfiguration, a user is able to see an object in rear of a terminalbody via the area occupied by the display 151 of the terminal body.

At least two displays 151 can be provided to the mobile terminal 100 inaccordance with the implemented configuration of the mobile terminal100. For instance, a plurality of displays can be arranged on a singleface of the mobile terminal 100 in a manner of being spaced apart fromeach other or being built in one body. Alternatively, a plurality ofdisplays can be arranged on different faces of the mobile terminal 100.

In case that the display 151 and the touch sensor 137 configures amutual layer structure (hereinafter called ‘touch screen’), it is ableto use the display 151 as an input device as well as an output device.In this case, the touch sensor can be configured as a touch film, atouch sheet, a touchpad or the like.

The touch sensor 137 can be configured to convert a pressure applied toa specific portion of the display 151 or a variation of a capacitancegenerated from a specific portion of the display 151 to an electricinput signal. Moreover, it is able to configure the touch sensor 137 todetect a pressure of a touch as well as a touched position or size.

If a touch input is made to the touch sensor 137, signal(s)corresponding to the touch is transferred to a touch controller. Thetouch controller processes the signal(s) and then transfers theprocessed signal(s) to the controller 180. Therefore, the controller 180is able to know whether a prescribed portion of the display 151 istouched.

Referring to FIG. 2, a proximity sensor (141) can be provided to aninternal area of the mobile terminal 100 enclosed by the touchscreen oraround the touchscreen. The proximity sensor is the sensor that detectsa presence or non-presence of an object approaching a prescribeddetecting surface or an object existing around the proximity sensorusing an electromagnetic field strength or infrared ray withoutmechanical contact. Hence, the proximity sensor has durability longerthan that of a contact type sensor and also has utility wider than thatof the contact type sensor.

The proximity sensor can include one of a transmittive photoelectricsensor, a direct reflective photoelectric sensor, a mirror reflectivephotoelectric sensor, a radio frequency oscillation proximity sensor, anelectrostatic capacity proximity sensor, a magnetic proximity sensor, aninfrared proximity sensor and the like. In case that the touchscreenincludes the electrostatic capacity proximity sensor, it is configuredto detect the proximity of a pointer using a variation of electric fieldaccording to the proximity of the pointer. In this case, the touchscreen(touch sensor) can be classified as the proximity sensor.

For clarity and convenience of the following description, as a pointerbecomes proximate to a touchscreen without coming into contact with thetouchscreen, if the pointer is perceived as situated over thetouchscreen, such an action shall be named ‘proximity touch’. If apointer actually comes into contact with a touchscreen, such an actionshall be named ‘contact touch’. A proximity-touched position over thetouchscreen with the pointer may mean a position at which the pointervertically opposes the touchscreen when the touchscreen isproximity-touched with the pointer.

The proximity sensor detects a proximity touch and a proximity touchpattern (e.g., a proximity touch distance, a proximity touch duration, aproximity touch position, a proximity touch shift state, etc.). And,information corresponding to the detected proximity touch action and thedetected proximity touch pattern can be outputted to the touchscreen.

The audio output module 152 functions in various modes including acall-receiving mode, a call-placing mode, a recording mode, a voicerecognition mode, a broadcast reception mode and the like to outputaudio data which is received from the wireless communication unit 110 oris stored in the memory 160. During operation, the audio output module152 outputs audio relating to a particular function (e.g., callreceived, message received, etc.). The audio output module 152 is oftenimplemented using one or more speakers, buzzers, other audio producingdevices, and combinations thereof.

The alarm unit 153 is output a signal for announcing the occurrence of aparticular event associated with the mobile terminal 100. Typical eventsinclude a call received event, a message received event and a touchinput received event. The alarm unit 153 is able to output a signal forannouncing the event occurrence by way of vibration as well as video oraudio signal. The video or audio signal can be outputted via the display151 or the audio output unit 152. Hence, the display 151 or the audiooutput module 152 can be regarded as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that can besensed by a user. Vibration is a representative one of the tactileeffects generated by the haptic module 154. Strength and pattern of thevibration generated by the haptic module 154 are controllable. Forinstance, different vibrations can be outputted in a manner of beingsynthesized together or can be outputted in sequence.

The haptic module 154 is able to generate various tactile effects aswell as the vibration. For instance, the haptic module 154 generates theeffect attributed to the arrangement of pins vertically moving against acontact skin surface, the effect attributed to the injection/suctionpower of air though an injection/suction hole, the effect attributed tothe skim over a skin surface, the effect attributed to the contact withelectrode, the effect attributed to the electrostatic force, the effectattributed to the representation of hold/cold sense using an endothermicor exothermic device and the like.

The haptic module 154 can be implemented to enable a user to sense thetactile effect through a muscle sense of finger, arm or the like as wellas to transfer the tactile effect through a direct contact. Optionally,at least two haptic modules 154 can be provided to the mobile terminal100 in accordance with the corresponding configuration type of themobile terminal 100.

The memory unit 160 is generally used to store various types of data tosupport the processing, control, and storage requirements of the mobileterminal 100. Examples of such data include program instructions forapplications operating on the mobile terminal 100, contact data,phonebook data, messages, audio, still pictures (or photo), movingpictures, etc. And, a recent use history or a cumulative use frequencyof each data (e.g., use frequency for each phonebook, each message oreach multimedia) can be stored in the memory unit 160. Moreover, datafor various patterns of vibration and/or sound outputted in case of atouch input to the touchscreen can be stored in the memory unit 160.

The memory 160 may be implemented using any type or combination ofsuitable volatile and non-volatile memory or storage devices includinghard disk, random access memory (RAM), static random access memory(SRAM), electrically erasable programmable read-only memory (EEPROM),erasable programmable read-only memory (EPROM), programmable read-onlymemory (PROM), read-only memory (ROM), magnetic memory, flash memory,magnetic or optical disk, multimedia card micro type memory, card-typememory (e.g., SD memory, XD memory, etc.), or other similar memory ordata storage device. And, the mobile terminal 100 is able to operate inassociation with a web storage for performing a storage function of thememory 160 on Internet.

The interface unit 170 is often implemented to couple the mobileterminal 100 with external devices. The interface unit 170 receives datafrom the external devices or is supplied with the power and thentransfers the data or power to the respective elements of the mobileterminal 100 or enables data within the mobile terminal 100 to betransferred to the external devices. The interface unit 170 may beconfigured using a wired/wireless headset port, an external chargerport, a wired/wireless data port, a memory card port, a port forcoupling to a device having an identity module, audio input/outputports, video input/output ports, an earphone port and/or the like.

The identity module is the chip for storing various kinds of informationfor authenticating a use authority of the mobile terminal 100 and caninclude User Identify Module (UIM), Subscriber Identify Module (SIM),Universal Subscriber Identity Module (USIM) and/or the like. A devicehaving the identity module (hereinafter called ‘identity device’) can bemanufactured as a smart card. Therefore, the identity device isconnectible to the mobile terminal 100 via the corresponding port.

When the mobile terminal 110 is connected to an external cradle, theinterface unit 170 becomes a passage for supplying the mobile terminal100 with a power from the cradle or a passage for delivering variouscommand signals inputted from the cradle by a user to the mobileterminal 100. Each of the various command signals inputted from thecradle or the power can operate as a signal enabling the mobile terminal100 to recognize that it is correctly loaded in the cradle.

The controller 180 typically controls the overall operations of themobile terminal 100. For example, the controller 180 performs thecontrol and processing associated with voice calls, data communications,video calls, etc. The controller 180 may include a multimedia module 181that provides multimedia playback. The multimedia module 181 may beconfigured as part of the controller 180, or implemented as a separatecomponent.

Moreover, the controller 180 is able to perform a pattern (or image)recognizing process for recognizing a writing input and a picturedrawing input carried out on the touchscreen as characters or images,respectively.

The power supply unit 190 provides power required by the variouscomponents for the mobile terminal 100. The power may be internal power,external power, or combinations thereof.

A battery may include a built-in rechargeable battery and may bedetachably attached to the terminal body for a charging and the like. Aconnecting port may be configured as one example of the interface 170via which an external charger for supplying a power of a batterycharging is electrically connected.

Various embodiments described herein may be implemented in acomputer-readable medium using, for example, computer software,hardware, or some combination thereof.

For a hardware implementation, the embodiments described herein may beimplemented within one or more application specific integrated circuits(ASICs), digital signal processors (DSPs), digital signal processingdevices (DSPDs), programmable logic devices (PLDs), field programmablegate arrays (FPGAs), processors, controllers, micro-controllers,microprocessors, other electronic units designed to perform thefunctions described herein, or a selective combination thereof. Suchembodiments may also be implemented by the controller 180.

For a software implementation, the embodiments described herein may beimplemented with separate software modules, such as procedures andfunctions, each of which perform one or more of the functions andoperations described herein. The software codes can be implemented witha software application written in any suitable programming language andmay be stored in memory such as the memory 160, and executed by acontroller or processor, such as the controller 180.

FIG. 2 is a front perspective diagram of a mobile terminal according toone embodiment of the present invention.

The mobile terminal 100 shown in the drawing has a bar type terminalbody. Yet, the mobile terminal 100 may be implemented in a variety ofdifferent configurations. Examples of such configurations includefolder-type, slide-type, rotational-type, swing-type and combinationsthereof. For clarity, further disclosure will primarily relate to abar-type mobile terminal 100. However such teachings apply equally toother types of mobile terminals.

Referring to FIG. 2A, the mobile terminal 100 includes a case (101, 102,103) configuring an exterior thereof. In the present embodiment, thecase can be divided into a front case 101 and a rear case 102. Variouselectric/electronic parts are loaded in a space provided between thefront and rear cases 101 and 102.

Occasionally, electronic components can be mounted on a surface of therear case 102. The electronic part mounted on the surface of the rearcase 102 may include such a detachable part as a battery, a USIM card, amemory card and the like. In doing so, the rear case 102 may furtherinclude a backside cover 103 configured to cover the surface of the rearcase 102. In particular, the backside cover 103 has a detachableconfiguration for user's convenience. If the backside cover 103 isdetached from the rear case 102, the surface of the rear case 102 isexposed.

Referring to FIG. 2, if the backside cover 103 is attached to the rearcase 102, a lateral side of the rear case 102 may be exposed in part. Ifa size of the backside cover 103 is decreased, a rear side of the rearcase 102 may be exposed in part. If the backside cover 103 covers thewhole rear side of the rear case 102, it may include an opening 103′configured to expose a camera 121′ or an audio output unit 152′externally.

The cases 101, 102 and 103 are formed by injection molding of syntheticresin or can be formed of metal substance such as stainless steel (STS),titanium (Ti) or the like for example.

A display 151, an audio output unit 152, a camera 121, user input units130/131 and 132, a microphone 122, an interface 180 and the like can beprovided to the case 101 or 102.

The display 151 occupies most of a main face of the front case 101. Theaudio output unit 152 and the camera 121 are provided to an areaadjacent to one of both end portions of the display 151, while the userinput unit 131 and the microphone 122 are provided to another areaadjacent to the other end portion of the display 151. The user inputunit 132 and the interface 170 can be provided to lateral sides of thefront and rear cases 101 and 102.

The input unit 130 is manipulated to receive a command for controllingan operation of the terminal 100. And, the input unit 130 is able toinclude a plurality of manipulating units 131 and 132. The manipulatingunits 131 and 132 can be named a manipulating portion and may adopt anymechanism of a tactile manner that enables a user to perform amanipulation action by experiencing a tactile feeling.

Content inputted by the first or second manipulating unit 131 or 132 canbe diversely set. For instance, such a command as start, end, scroll andthe like is inputted to the first manipulating unit 131. And, a commandfor a volume adjustment of sound outputted from the audio output unit152 and the like can be inputted to the second manipulating unit 132, acommand for a switching to a touch recognizing mode of the display 151and the like can be inputted to the second manipulating unit 133.

FIG. 3 is a perspective diagram of a backside of the terminal shown inFIG. 2.

Referring to FIG. 3, a camera 121′ can be additionally provided to abackside of the terminal body, and more particularly, to the rear case102. The camera 121 has a photographing direction that is substantiallyopposite to that of the former camera 121 shown in FIG. 2 and may havepixels differing from those of the firmer camera 121.

Preferably, for instance, the former camera 121 has low pixels enough tocapture and transmit a picture of user's face for a video call, whilethe latter camera 121′ has high pixels for capturing a general subjectfor photography without transmitting the captured subject. And, each ofthe cameras 121 and 121′ can be installed at the terminal body to berotated or popped up.

A flash 123 and a mirror 124 are additionally provided adjacent to thecamera 121′. The flash 123 projects light toward a subject in case ofphotographing the subject using the camera 121′. In case that a userattempts to take a picture of the user (self-photography) using thecamera 121′, the mirror 124 enables the user to view user's facereflected by the mirror 124.

An additional audio output unit 152′ can be provided to the backside ofthe terminal body. The additional audio output unit 152′ is able toimplement a stereo function together with the former audio output unit152 shown in FIG. 2 and may be used for implementation of a speakerphonemode in talking over the terminal.

A broadcast signal receiving antenna 116 can be additionally provided tothe lateral side of the terminal body as well as an antenna forcommunication or the like. The antenna 116 constructing a portion of thebroadcast receiving module 111 shown in FIG. 1 can be retractablyprovided to the terminal body.

For clarity and convenience of the following description, assume that amobile terminal according to the present invention includes at least oneof the components shown in FIG. 1. In particular, assume that the mobileterminal according to the present invention includes the wirelesscommunication unit 110, the display unit 151, the memory 160 and thecontroller 180.

If the display module or unit 151 is implemented with a touchscreen, thedisplay unit 151 can play both a role as an output device and a role asan input device to facilitate the implementation of the mobile terminalaccording to the present invention. Therefore, assume that the displayunit 151 in the following embodiments may include the touchscreen.

For clarity, according to embodiments mentioned in the followingdescription, a person intending to use the mobile terminal according tothe present invention shall be named a user. And, a person (or a mobileterminal of the corresponding person) intending to communicate (e.g., toexchange phone calls, text messages, instant messages, emails, etc.)with the mobile terminal according to the present invention shall benamed a counterpart (or a counterpart terminal).

In the following description, a mobile terminal 100 according to thepresent invention is explained in detail with reference to FIG. 4.

FIG. 4 is a flowchart for an operation of a mobile terminal according tothe present invention.

Referring to FIG. 4, if it is determined that an event has beentriggered by a prescribed counterpart [S401], the controller 180extracts an image data related to the prescribed counterpart havingtriggered the event so that the extracted image data will be outputtedthrough the display unit 151 [S402].

In this case, the event, which can be triggered by the prescribedcounterpart, may include one of a case that an incoming call is receivedfrom the prescribed counterpart, a case that a message (e.g., a textmessage, an instant message, etc.) is received from the prescribedcounterpart, a case that the prescribed counterpart registers a reply toa posting at an SNS (social network service) account of a user, a casethat the prescribed counterpart sends an email to an email account of auser, a case that a direct communication connection request (e.g., aWi-Fi Direct connection request, a Bluetooth paring request, etc.) isreceived from the prescribed counterpart, a case that a request for adata sharing (e.g., Miracast, a file sharing, etc.) is received from theprescribed counterpart, and the like.

And, the image data related to the prescribed counterpart may include atleast one of a photo/video containing the prescribed counterpart and aphoto/video having a prescribed counterpart's identification informationtagged as a metadata. The controller 180 may be able to extract theimage data related to the prescribed counterpart from a photo or videosaved in the memory 160 of the mobile terminal. And, the controller 180may be able to extract the image data related to the prescribedcounterpart from an external server (e.g., an SNS server, a messengerserver, other photo management servers (e.g., an album managementserver), etc.).

After the controller 180 has primarily extracted the image data relatedto the prescribed counterpart from the memory 160, if the controller 180is unable to further extract image data related to the prescribedcounterpart from the memory 160, the number of the extracted image datais equal to or smaller than a prescribed number, or the mobile terminalis set to extract the image data related to the prescribed counterpartfrom the external server, the controller 180 may be able to extractimage data related to the prescribed counterpart secondarily. Foranother instance, the controller 180 is able to attempt to extract imagedata related to the prescribed counterpart from both of the memory 180and the external server irrespective of a presence or non-presence ofextraction of image data from the memory 160.

In extracting the image data related to the prescribed counterpart, thecontroller 180 can extract the image data related to the prescribedcounterpart by checking whether a photo saved in the memory 160 or theexternal server is tagged with an identification information of theprescribed counterpart. Alternatively, the control 180 can extract animage data of a photographed character regarded as the same person ofthe prescribed counterpart using a face recognition algorithm. In thiscase, the identification information of the prescribed counterpart mayinclude at least one of a name of a counterpart registered in aphonebook, an ID (or nickname) of a counterpart registered in amessenger server, an ID (or nickname) of a counterpart registered in anSNS server, and the like. And, a prescribed counterpart's photocorresponding to a reference for applying the face recognition algorithmmay include at least one of a profile photo of a prescribed counterpartregistered in the phonebook, a profile photo of a prescribed counterpartregistered at a messenger account, a profile photo of a prescribedcounterpart registered at an SNS account, and the like. In doing so, ifthere exists the profile photo of the prescribed counterpart registeredin the phonebook, the controller 180 firstly extracts the image datarelated to the prescribed counterpart using the profile photo of theprescribed counterpart registered in the phonebook. Subsequently, if theprofile photo of the prescribed counterpart is unregistered in thephonebook or the controller 180 is unable to extract the image datarelated to the prescribed counterpart as the profile photo registered inthe phonebook, the controller 180 can attempt to extract the image datarelated to the prescribed counterpart using the profile photo registeredin the external server (e.g., a messenger server, an SNS server, etc.)for the first time.

Once the image data related to the prescribed counterpart havingtriggered the event is extracted, the controller 180 is able to controlthe image data related to the prescribed counterpart to be outputtedthrough at least one partial region of the display_unit 151 in order toannounce that the corresponding event has occurred [S403].

FIG. 5 is a diagram to describe one example of outputting an image datarelated to a prescribed counterpart to the display unit 151 in responseto an occurrence of an event.

FIG. 5(a) is a diagram for one example of an output of a mobile terminalwhen a prescribed counterpart makes a phone call. If a prescribedcounterpart makes a phone call, the controller 180 is able to extract animage data related to the prescribed counterpart making the phone call.In particular, as mentioned in the foregoing description, the controller180 is able to extract a photo/video containing the prescribedcounterpart therein or a photo/video tagged with information of theprescribed counterpart as the image data related to the prescribedcounterpart. Once the image data related to the prescribed counterpartis extracted, like the example shown in FIG. 5(a), the controller 180 isable to control the extracted image data 510 related to the prescribedcounterpart to be displayed on a call connecting screen. FIG. 5(a) showsone example that the image data 510 is displayed through a partialregion (e.g., a middle part of the screen) of the call connectingscreen. Instead, the image data can be outputted as a background of thecall connecting screen.

FIG. 5(b) is a diagram for one example of an output of a mobile terminalwhen a message is received from a prescribed counterpart. If a messageis received from a prescribed counterpart, the controller 180 is able toextract an image data related to the prescribed counterpart having sentthe message. Once the image data related to the prescribed counterpartis extracted, like the example shown in FIG. 5(b), the controller 180 isable to control the extracted image data 530 related to the prescribedcounterpart to be displayed on a popup window 520 announcing thereception of the message. FIG. 5(b) shows one example that the imagedata 530 is displayed through a partial region of the popup window 520.Instead, the image data 530 can be outputted as a background of thepopup window 520.

Like the examples shown in FIG. 5(a) and FIG. 5(b), in case that anevent is triggered by a prescribed counterpart, the controller 180controls image data related to the prescribed counterpart to beoutputted, thereby providing information on the counterpart havingtriggered the event to a user. In doing so, the displayed image data mayinclude an exact original copy or a preview (e.g., a thumbnail, etc.).

If the image data related to the prescribed counterpart is touched, thecontroller 180 can control a list of the image data related to theprescribed counterpart to be displayed. One example of displaying theimage data list is described in detail with reference to FIG. 6 asfollows.

FIG. 6 is a diagram to describe one example of displaying an image datalist. For clarity of the following description, assume that a popupwindow 610 for announcing that a message has been received from aprescribed counterpart is currently displayed on the display unit 151.

Referring to FIG. 6, if an image data 620 of a prescribed counterpartcurrently outputted through a popup window 610 is touched [FIG. 6(a)],the controller 180 is able to control an image data list 630 related tothe prescribed counterpart to be displayed [FIG. 6(b)]. In this case,previews (e.g., thumbnails) of a plurality of collected image data canbe displayed on the image data list 630. When the prescribed counterpartand the image data list 630 are displayed, the controller 180 can sortthe image data by a prescribed reference. In this case, the referencefor sorting the image data may include one of an image data createddate, a lately inquired date of image data, a play (or inquiry) count ofimage data and the like.

If a prescribed image data is selected from the image data list 630,referring to FIG. 6(c), the controller 180 is able to control theselected image data (i.e., an original copy 640 of the selected imagedata) to be displayed.

Like the example shown in FIG. 6, as an image data related to aprescribed counterpart is displayed, a user is able to check a multitudeof image data related to the prescribed counterpart conveniently andeasily.

When an image data related to a prescribed counterpart is displayed, thecontroller 180 can control a location information of the displayed imagedata to be displayed as well. In this case, the location information maymeans a location at which the image data is saved. Hence, a user is ableto determine where a currently displayed image data is saved through thelocation information conveniently and easily.

For instance, FIG. 7 is a diagram to describe one example of displayinglocation information. Like the examples shown in FIGS. 7(a) to 7(c), thecontroller 180 can control an object (e.g., an icon, an indicator, etc.)710/720/730, which indicates a saved location of an image data, to bedisplayed on the corresponding image data. FIG. 7(a) shows one examplethat the object 710 indicating that an image data related to aprescribed counterpart has been extracted from the memory 160 of themobile terminal. FIG. 7(b) shows one example that the object 720indicating that an image data related to a prescribed counterpart hasbeen extracted from a messenger server. And, FIG. 7(c) shows one examplethat the object 730 indicating that an image data related to aprescribed counterpart has been extracted from an SNS server.

An address of an access to a location having an image data saved thereatmay be linked to an object indicating a location information of theimage data related to a prescribed counterpart. Hence, if receiving auser input for selecting (e.g., touching) the object indicating thelocation information, the controller 180 can attempt an access to theimage data saved location. For instance, if receiving a user input oftouching an object indicating that an image data is saved in the memory160, the controller 180 activates a gallery application so as to controlan image data list saved in the memory 160 to be displayed. Moreover, ifreceiving a user input of touching an object indicating that an imagedata has been extracted from an external server such as a messengerserver, an SNS server and the like, the controller 180 can access anaccount of a prescribed counterpart in the external server (e.g., themessenger server in FIG. 7(b), the SNS server in FIG. 7(c), etc.).

In particular, an image data saved location can be indicated through alocation information and a user can be provided with facilitation of aquick access to the image data saved location.

The mobile terminal according to the present invention can control imagedata related to a counterpart to be displayed in case of an occurrenceof an event. And, the mobile terminal according to the present inventionis also able to control image data related to a counterpart to bedisplayed when an event occurrence list is displayed to check anoccurring event. In this case, the event occurrence list may includesuch a list for checking an event occurring in the mobile terminal as aphonebook list, a transceived text message list, a call list, an absentcall list, a counterpart list (i.e., a friend list) of a user'smessenger account (i.e., an account registered in a messenger server), atransceived instant message list, a counterpart list (e.g., a friendlist) of a user's SNS account (i.e., an account registered in an SNSserver), a counterpart list of counterparts available for short-rangecommunication establishments, and the like.

An embodiment of outputting an image data of a counterpart to an eventoccurrence list is described in detail with reference to FIG. 8 asfollows.

FIG. 8 is a diagram to describe one example of outputting an image dataof a counterpart to an event occurrence list.

Referring to FIG. 8, an event occurrence content per counterpart can bedisplayed on an event occurrence list. In this case, a per-counterpartdisplay region may include a first region 810 for outputting an imagedata related to a counterpart and a second region 820 for displayinginformation of the counterpart. In particular, the counterpartinformation outputted through the second region 820 may include a nameof the counterpart, a nickname of the counterpart, an ID (e.g., an IDfor using an instant messenger, an ID for using an SNS service, etc.) ofthe counterpart, a phone number of the counterpart of an incoming call,a content of a message or email recently transceived with thecounterpart, a content of a posting written by the counterpart on an SNSaccount of his own, and the like. In the example shown in FIG. 8, a nameof the counterpart and a content of a message most recently transceivedwith the counterpart are displayed on the second region 820.

Like the example shown in FIG. 8(a), the image data related to thecounterpart can be outputted through the first region 810. Hence, a useris able to check image data related to a prescribed counterpart throughthe image data displayed on the first region 810.

The controller 180 is able to control each image data to be outputtedfor every counterpart disclosed on the event occurrence list. Foranother instance, the controller 180 can control image data to bedisplayed in a manner as follows. First of all, the controller 180 sortsout counterparts into a profile photo registered counterpart and aprofile photo unregistered counterpart. Secondly, the controller 180displays a profile photo of the photo registered counterpart. Thecontroller 180 extracts an image data of the profile photo unregisteredcounterpart and then displays the extracted image data. For furtherinstance, the controller 180 only performs an image data extractingprocess on a counterpart having triggered a new event and then controlsthe extracted image data to be displayed.

If a touch input to the first region 810 is received (e.g., in FIG.8(a), a touch input is received in a manner of moving a pointer in aspecific direction from the first region 810 of a prescribedcounterpart), the controller 180 can control an image data list 830 ofthe selected counterpart to be displayed [FIG. 8(b)]. In this case,thumbnail images (or preview images) of the collected image data can bedisplayed on the image data list 830. In doing so, the controller 180may control the image data list 830 to be displayed at a locationadjacent to a display region of the corresponding counterpart in thecounterpart list. Alternatively, like the example shown in FIG. 8(b),the controller 180 pushes out a display region of the selectedcounterpart in a prescribed direction and then controls the image datalist 830 to be displayed at the former location of the display region ofthe selected counterpart.

If a prescribed image data is selected from the image data list 830,referring to FIG. 8(c), the controller 180 can control the selectedimage data (e.g., an original copy 840 of the selected image data, etc.)to be displayed.

When the image data is displayed, as mentioned in the foregoingdescription, the controller 180 can display an object 850 indicating alocation information of the displayed image data as well.

If a specific counterpart is selected from an event occurrence list, thecontroller 180 can details of an occurring event. For instance, if aprescribed counterpart is selected from a transceived text message listshown in FIG. 8(a) referring to FIG. 9(a) the controller 180 can controlcontents of text messages transceived with the selected counterpart tobe outputted. In doing so, the controller 180 can assign at least onepartial region of the display unit 151 as a region through which animage data 910 related to the counterpart will be outputted. Inparticular, referring to FIG. 9(a), the image data 910 is outputtedthrough a left top end of the display unit 151.

In doing so, while the details of the event are displayed, if aprescribed user input is applied to the image data 910 (e.g., in theexample shown in FIG. 9(a), a pinch-out input is applied to the imagedata 910), like the example shown in FIG. 9(b), the controller 180 cancontrol the details of the event to be set as a background 920 of adisplay screen. In this case, the details of the event (e.g., messagestransceived with the counterpart, etc.) can be semi-transparentlyoutputted over the image data 920 set as the background.

Thereafter, if a prescribed user input is applied to the image data 920set as the background (e.g., in the example shown in FIG. 9(b), apinch-in input is applied to the image data 920 set as the background),referring to FIG. 9(c), the controller 180 can control the image data910 to be outputted through the originally assigned region.

Like the examples shown in FIGS. 4 to 9, the mobile terminal accordingto the present invention can output image data related to a counterparthaving triggered an event irrespective of a presence or non-presence ofregistration of a profile photo of the counterpart. In particular,although a user fails to register a profile photo per counterpart in aphonebook or the like, an image data related to a counterpart can beoutputted.

According to another embodiment, in FIG. 4, the steps S402 and S403 ofextracting the image data related to the prescribed counterpart havingtriggered the event can be performed on the condition that a profilephoto of the prescribed counterpart is not registered. In particular, ifthe profile photo of the counterpart having triggered event is alreadyregistered (e.g., the profile photo is registered in the phonebook), thecontroller 180 outputs the previously registered profile photo insteadof extracting the image data related to the prescribed counterpart. Ifthe profile photo of the counterpart having triggered the event is notregistered, the controller 180 attempts to extract the image datarelated to the prescribed counterpart and is then able to control theextracted image data to be outputted. In doing so, the controller 180 isable to control the extracted image data to be automatically registeredas the profile photo of the prescribed counterpart having triggered theevent. In particular, if the image data related to the prescribedcounterpart, of which profile photo is unregistered, is extracted, thecontroller 180 may control the extracted image data to be automaticallyset as the profile photo of the prescribed counterpart.

Based on the above descriptions, various embodiments performed by themobile terminal of the present invention shall be described in detail asfollows.

<Outputting New Image Data on Each Occurrence of Event>

If a plurality of image data of a prescribed counterpart exist, thecontroller 180 can control a new image data to be outputted each time anevent is triggered by the prescribed counterpart. For instance, thecontroller 180 can control a plurality of the image data to besequentially outputted by a prescribed reference. For another instance,the controller 180 can control a prescribed image data, which israndomly selected from a plurality of the image data, to be outputted.In this case, a reference for sorting the image data may include one ofan image data created date, a date of a most recently inquiry of theimage data, a count of inquiry (or play) of the image data, and thelike.

For instance, FIG. 10 is a diagram for one example of outputting a newimage data in response to each occurrence of an event triggered by aprescribed counterpart. FIG. 10(a) shows one example of sorting aplurality of image data of a prescribed counterpart by a prescribedreference. And, FIG. 10(b) is a diagram for one example of an output ofa mobile terminal when an event is triggered by a prescribedcounterpart. Referring to FIG. 10(a) and FIG. 10(b), the controller 180can control new image data to be sequentially outputted each time anevent is triggered by a prescribed counterpart. For instance, if a firstevent is triggered by a prescribed counterpart, the controller 180controls a first image data 1010 among a plurality of image data relatedto the prescribed counterpart to be outputted. If a second event istriggered by the prescribed counterpart, the controller 180 controls asecond image data 1020 among a plurality of the image data to beoutputted. Thus, the controller 180 is able to control a new image datato be outputted each time an event occurs.

The controller 180 may apply a different sorting reference depending onthe number of image data. In particular, if the number of image datarelated to a prescribed counterpart is equal to or smaller than N, thecontroller 180 applies a first sorting reference. If the number of imagedata related to a prescribed counterpart is greater than N, thecontroller 180 applies a second sorting reference. Thus, the controller180 can determine the image data to output sequentially. For instance,if the first sorting reference is a photographed order of the image dataand the second sorting reference is an inquired order of the image data,when the number of image data is not considerable (i.e., equal to orsmaller than N), the image data are firstly outputted in thephotographed time order. If the number of the image data becomesconsiderable, the image data can be outputted in order of the image datamost frequently inquired by a user.

According to another embodiment, if an event is triggered by aprescribed counterpart, the controller 180 can control a prescribedimage data, which is selected from a plurality of image data related tothe prescribed counterpart, to be outputted. In doing so, in order toprevent the same image data to be consecutively outputted, thecontroller 180 may be able to randomly select a prescribed image datafrom the rest of the image data except a most recently outputted imagedata.

According to another embodiment, the controller 180 can control a latestimage data (e.g., a most recently created image data, a most recentlyupdated image data, etc.), which is selected from a plurality of imagedata of a prescribed counterpart, to be displayed. In particular,although there are a plurality of image data of a prescribedcounterpart, the controller controls a latest image data to bedisplayed, thereby enabling a user to check a most recent appearance (orlook) of the prescribed counterpart.

<Determining Type of Image Data to be Outputted Through Display Unit151>

The mobile terminal according to the present invention can determine atype of an image data, which is to be outputted through the display unit151, depending on an operating status of the mobile terminal or a typeof an occurring event.

According to one embodiment, while the mobile terminal is operating invibration mode (i.e., a sound-muted state), the controller 180 cancontrol a photo related to a prescribed counterpart to be displayed inresponse to an event occurrence. If the mobile terminal is operating insound mode (i.e., a sound-outputtable state), the controller 180 cancontrol a video related to a prescribed counterpart to be displayed inresponse to an event occurrence.

FIG. 11 is a diagram for one example of adjusting a type of an imagedata related to a prescribed counterpart depending on a setup value of amobile terminal. FIG. 11(a) shows one example of a state that a mode ofa mobile terminal is set to a vibration mode. And, FIG. 11(b) shows oneexample of a state that a mode of a mobile terminal is set to a soundmode. For clarity of the following description, assume that an occurringevent includes an incoming call. While a mode of the mobile terminal isset to a vibration mode, if an incoming call is received from aprescribed counterpart, like the example shown in FIG. 11(a), thecontroller 180 is able to control a photo related to a prescribedcounterpart, who has triggered an event, to be outputted. On the otherhand, while a mode of the mobile terminal is set to a sound mode, if anincoming call is received from a prescribed counterpart, like theexample shown in FIG. 11(b), the controller 180 can control a video,which is related to a prescribed counterpart having triggered an event,to be outputted.

In particular, like the examples shown in FIG. 11(a) and FIG. 11(b), thecontroller 180 can determine whether to output a photo or video as animage data related to a prescribed counterpart depending on whether themobile terminal is in a state or mode appropriate for outputting audioor sound.

In case that a video related to a prescribed counterpart is outputted,the controller 180 controls audio data of the video to be outputtedinstead of a call ringtone or can control a call ringtone to beoutputted by omitting an output of audio data of the video (i.e., byoutputting video data only). For another instance, the controller 180can control both a call ringtone and an audio data of a video to besimultaneously outputted. For another instance, depending on an outputstrength of an audio data of a video, the controller 180 can control anoutput of the call ringtone to be omitted if the output strength of theaudio data is high. If the output strength of the audio data is low, thecontroller 180 can control the call ringtone to be outputted.

For further instance, depending on a type of an occurring event, thecontroller 180 can determine a type of an image data. In particular, ifan event of a first type is triggered by a prescribed counterpart, thecontroller 180 can control a photo related to the prescribed counterpartto be displayed in response to an occurrence of the event. If an eventof a second type occurs, the controller 180 can control a video relatedto the prescribed counterpart to be displayed in response to anoccurrence of the event.

FIG. 12 is a diagram for one example of adjusting a type of an imagedata related to a prescribed counterpart depending on a type of anoccurring event. For clarity of the following description, assume thatan event of a first type is to receive a message (e.g., a text message,an instant message, etc.) from a prescribed counterpart. And, assumethat an event of a second type is an incoming call from a prescribedcounterpart (i.e., an event that a prescribed counterpart makes a phonecall).

Referring to FIG. 12(a), if a message is received from a prescribedcounterpart, the controller 180 can control a photo of the prescribedcounterpart to be outputted through a popup window indicating that themessage has been received. On the other hand, referring to FIG. 12(b),if there is an inkling call from a prescribed counterpart, thecontroller 180 can control a video of the prescribed counterpart to beoutputted through a call connecting screen.

In particular, like the examples shown in FIG. 12(a) and FIG. 12(b), thecontroller 180 is able to determine whether to output a photo or a videoas an image data related to a prescribed counterpart depending on a typeof an occurring event.

<Determining Image Data to Display in Consideration of Time Slot>

The mobile terminal according to the present invention is able todetermine image data, which is to be outputted through the display unit151, in consideration of a current time. For instance, a current time isdiscriminated into a daytime or a nighttime. If a current timecorresponds to a daytime, an image data of a bright line can beoutputted. If a current time corresponds to a nighttime, an image dataof a dark line can be outputted. In doing so, it is able to determinewhether the image data corresponds to the bright line or the dark lineusing at least one of brightness, color and chroma of the image data(e.g., photo, video, etc.). For instance, a taken photo or video can behandled as corresponding to a bright line if its brightness value isequal to or greater than a first preset limit. For another instance, ataken photo or video can be handled as corresponding to a dark line ifits brightness value is equal to or smaller than a second limit. Ifchromatic color is dominantly used for a taken photo or video, it can behandled as corresponding to a bright line. If achromatic color isdominantly used for a taken photo or video, it can be handled ascorresponding to a dark line. For further instance, a photo or videotaken in daytime can be handled as corresponding to a bright line.

FIG. 13 is a diagram for one example of outputting a different imagedata per time slot. FIG. 13(a) is a diagram for one example of an outputin case that a current time corresponds to a daytime. And, FIG. 13(b) isa diagram for one example of an output in case that a current timecorresponds to a nighttime. For clarity of the following description,assume that a photo having a shaded background indicates a photo of adark line. And, assume that a photo not having a shaded backgroundindicates a photo of a bright line.

In case that an event is triggered in the daytime by a prescribedcounterpart, referring to FIG. 13(a), the controller 180 can control animage data of a bright line to be outputted. On the other hand, in casethat an event is triggered in the nighttime by a prescribed counterpart,referring to FIG. 13(b), the controller 180 can control an image data ofa dark line to be outputted.

According to another embodiment, the mobile terminal of the presentinvention can determine an image data, which is to be outputted per timeslot, using a photographing time information in metadata of a photo orvideo. For instance, if an event occurring time is 1:00 PM, thecontroller 180 can control an image data, of which photographed time isclosest to 1:00 PM, to be outputted.

<Determining Image Data to Display in Consideration of Place>

The mobile terminal according to the present invention is able tocontrol an image data, which is taken at a location closest to a currentlocation of the mobile terminal, to be outputted. In this case, thecurrent location of the mobile terminal may be obtained from theposition location module 115. And, the image data taken location can beobtained from a location information with which the image data istagged.

<Display of Fake Data>

The mobile terminal according to the present invention can display afake data having nothing to do with a prescribed counterpart instead ofdisplaying an image data related to the prescribed counterpart havingtriggered the occurrence.

For instance, FIG. 14 is a diagram for one example of outputting a fakedata. FIG. 14(a) shows a screen provided to a user in order to setwhether to output an image data related to a prescribed counterparthaving triggered an event. FIG. 14(a) and FIG. 14(b) are diagrams forone example of an output through the display unit 151 depending on asetup value.

Referring to FIG. 14, the controller 180 can control a setup value,which indicates whether to output an image data related to acounterpart, to be saved in the memory 160 per counterpart registered ina phonebook. In doing so, in order to adjust the setup value, referringto FIG. 14(a), the controller 180 can control a toggle key 1410, whichis provided to adjust the setup value, to be displayed on a detailedscreen of the counterpart registered in the phonebook. Based on a user'smanipulation on the toggle key 1410, the controller 180 is able to savethe setup value per counterpart registered in the phonebook.

In case that an event is triggered by a counterpart set to output animage data, referring to FIG. 14(b), the controller 180 can control animage data 1420, which is related to the counterpart having triggeredthe event, to be outputted.

On the other hand, if an event is triggered by a counterpart set not tooutput an image data, referring to FIG. 14(c), the controller 180 cancontrol a fake data 1430 (e.g., an image not related to a counterparthaving triggered an event, an emoticon of the counterpart, a video ofthe counterpart, etc.), which has nothing to do with the counterparthaving triggered the event, to be outputted.

While an image data related to a counterpart having triggered an eventis outputted, if a user input for blocking the image data related to thecounterpart is received from a user, the mobile terminal according tothe present invention can control a fake data to be outputted bystopping outputting the image data.

For instance, FIG. 15 is a diagram for another example of outputting afake data. For clarity of the following description, assume that a userinput for blocking an image data may include a palm touch performed in amanner of touching a touchscreen with a palm. Referring to FIG. 15,while an image data 1510 related to a counterpart having triggered anevent is outputted, if a user input for blocking the image data 1510 isapplied [FIG. 15(a), FIG. 15(b)], the controller 180 can control a fakedata 1520 to be outputted instead of the image data 1510 [FIG. 15(c)].

Meanwhile, while the fake data is outputted, if a user input forblocking the fake data is received, the fake data stops being outputtedand the image data can be outputted [not shown in the drawing].

For clarity of the description, FIG. 15 shows one example that a touchto a touchscreen with a palm is a user input for blocking an image data.For another instance, an action performed in a manner of zigzagging apointer touching a touchscreen as if erasing a displayed image data withan eraser can be defined as a user input for switching between an imagedata and a fake data.

<Outputting Fake Data Depending on Time and Place>

In case that an event is triggered by a prescribed counterpart in apreset time slot or a preset location range, the controller 180 cancontrol a fake data to be outputted instead of an image data related tothe prescribed counterpart. On the other hand, in case that an event istriggered by a prescribed counterpart out of a preset time slot or apreset location range, the controller 180 can control an image datarelated to the prescribed counterpart to be outputted.

For instance, FIG. 16 and FIG. 17 are diagrams for examples to describea changed phase of a data outputted through the display unit 151. Inparticular, FIG. 16 is a diagram for one example that a type of anoutputted data is changed per time slot. And, FIG. 17 is a diagram forone example that a type of an outputted data is changed per location.

For clarity of the following description, assume that a time set tooutput a fake data ranges 9 AM to 5 PM. And, assume that a location setto output a fake data is a workplace.

According to one embodiment, if an event triggered by a prescribedcounterpart is in a time set to output a fake data, the controller 180can control the fake data to be outputted instead of an image datarelated to the prescribed counterpart. In the example shown in FIG.16(a), as an event occurs 10 AM, a fake data 1610 is outputted. On theother hand, if an event triggered by a prescribed counterpart is outputof a time set to output a fake data, the controller 180 can control animage data related to the prescribed counterpart to be outputted. In theexample shown in FIG. 16(b), as an event occurs 6 PM, an image data 1620related to a prescribed counterpart is outputted.

According to another embodiment, if the mobile terminal is in a locationrange set to output a fake data, the controller 180 can control the fakedata to be outputted instead of an image data related to the prescribedcounterpart. In the example shown in FIG. 17(a), as an event occurs whenthe mobile terminal is located at a workplace, a fake data 1710 isoutputted. On the other hand, if the mobile terminal is located outputof a location range set to output a fake data, the controller 180 cancontrol an image data related to the prescribed counterpart to beoutputted. In the example shown in FIG. 17(b), as an event occurs whenthe mobile terminal is located at home, an image data 1720 related to aprescribed counterpart is outputted.

Like the examples shown in FIG. 16 and FIG. 17, the controller 180 isable to determine whether to output an image data or a fake data inconsideration of at least one of a preset time and a preset locationrange. In FIG. 16, a time element is considered only. In FIG. 17, alocation element is considered only. Yet, of course, it is able todetermine whether to output an image data or a fake data by consideringboth of a time element and a location element compositively.

<Determining Whether to Output Fake Data Depending on Level ofFriendliness With Counterpart>

The mobile terminal according to the present invention is able todetermine whether to output an image data or a fake data inconsideration of a level of friendliness with a counterpart havingtriggered an event. For instance, if a level of friendliness with aprescribed counterpart having triggered an event is lower than a presetreference value, the controller 180 can control a fake data to beoutputted instead of an image data related to the prescribedcounterpart. For another instance, if a level of friendliness with aprescribed counterpart having triggered an event is higher than a presetreference value, the controller 180 can control an image data related tothe prescribed counterpart to be outputted.

In doing so, the level of the friendliness with the counterpart can bemanually determined by a user or may be automatically determined basedon information on communication with the counterpart. In this case, theinformation on the communication with the counterpart may include atleast one of the number of calls with the counterpart, the number ofmessage transmissions to the counterpart, the number of prohibited wordutterance on a call, the number of prohibited word detection from amessage, and the like.

For instance, if the number of the calls with the counterpart and/or thenumber of message transmissions increases, it is able to give a highpoint to the friendliness level. Yet, although the number of calls witha user and/or the number of message transmissions to the user is high,if the number of utterance of the prohibited words (e.g., slangs,abusive languages, etc.) utterance in a content mentioned during a callor a message content, it is able to set the level of the friendlinesswith the counterpart to be lowered.

FIG. 18 is a diagram to describe an output of a display unit dependingon a level of friendliness with a counterpart. FIG. 18(a) is a diagramfor one example of a case that an event is triggered by a counterparthaving a high friendliness level. And, FIG. 18(b) is a diagram for oneexample of a case that an event is triggered by a counterpart having alow friendliness level. In case that an event is triggered by acounterpart having a high friendliness level, referring to FIG. 18(a),the controller 180 can control an image data 1810 related to thecounterpart to be outputted. On the contrary, in case that an event istriggered by a counterpart having a low friendliness level, referring toFIG. 18(b), the controller 180 can control a fake data having nothing todo with the counterpart to be outputted.

Like the example shown in FIG. 18, the controller 180 is able todetermine whether to output an image data or a fake data depending on alevel of friendliness with a counterpart.

<Output of Distorted Image Data>

As mentioned in the foregoing descriptions of the embodiments foroutputting fake data with reference to FIGS. 14 to 18, a distorted imagedata can be outputted instead of the fake data. In this case, thedistorted image data may mean a mosaicked photo/video, an artificiallydistorted photo/video, or the like.

<Output of Supplementary Data>

If an event is triggered by a prescribed counterpart, the controller 180is able to control supplementary data on the prescribed counterpart tobe outputted. In this case, the supplementary data may include one of aschedule data with the prescribed counterpart, a piece of writingrecently posted by the prescribed counterpart at an SNS account of theprescribed counterpart, and the like.

The controller 180 is able to output the supplementary data togetherwith an image data. Alternatively, the controller 180 can display notthe image data but the supplementary data only. Embodiments foroutputting the supplementary data are described in detail with referenceto FIG. 19 and FIG. 20 as follows.

FIG. 19 and FIG. 20 are diagrams to describe examples of outputtingsupplementary data. In particular, FIG. 19 is a diagram for one exampleof outputting a schedule data with a counterpart. And, FIG. 20 is adiagram for one example of outputting a posting recently posted by aprescribed counterpart at an SNS account of the prescribed counterpart.

If a schedule data with a counterpart having triggered an event exists,the controller 180 can control the schedule data with the counterpart tobe displayed. In doing so, like the example shown in FIG. 19(a), thecontroller 180 can output the schedule data together with an image datarelated to the counterpart. Like the example shown in FIG. 19(b), thecontroller 180 may output the schedule data only by omitting to outputthe image data related to the counterpart. When both of the scheduledata and the image data are simultaneously outputted, referring to FIG.19(b), the schedule data can be semi-transparently displayed over theimage data. Alternatively, after a region for outputting the image datahas been discriminated from a region for outputting the schedule data,it is able to control the image data and the schedule data to bedisplayed on the separate regions, respectively [not shown in thedrawing].

Referring to FIG. 19(c), the controller 180 of the present invention cancontrol a map screen, which indicated a place indicated by the scheduledata, to be displayed.

Yet, although there is a planned schedule with a counterpart, if theschedule is supposed to be triggered in the future, it may beunnecessary display the schedule data now. Hence, only if the scheduledata is present on the same date of the event occurrence, the controller180 can control the schedule data to be outputted. Alternatively, onlyif the schedule data is present in a prescribed time from an eventtriggered time, the controller 180 can control the schedule data to beoutputted.

If there is a posting recently posted at an SNS account by thecounterpart having triggered an event, the controller 180 can controlthe recent posting of the counterpart to be displayed. In doing so, likethe example shown in FIG. 20(a), the controller 180 can output a postingonly by omitting an output of an image data related to a counterpart.Like the example shown in FIG. 20(b), the controller 180 can output aposting together with an image data related to a counterpart. Inparticular, the controller 180 may control an object 2010, whichindicates a source of the posting, to be outputted as well. If theobject 2010 is touched, as mentioned in the foregoing description, it isable to attempt an access to an SNS account of a counterpart.

Moreover, in case that both a posting and an image data aresimultaneously outputted, like the example shown in FIG. 20(b), theposting can be semi-transparently displayed over the image data.Alternatively, after a region for outputting the image data has beendiscriminated from a region for outputting the schedule data, it is ableto control the image data and the schedule data to be displayed on theseparate regions, respectively [not shown in the drawing].

And, the controller 180 can control a posting (e.g., a postingregistered in a prescribed past time from an event triggered time)recently registered by a counterpart or a posting (e.g., a postingregistered after a timing point of a last access to an SNS account of acounterpart) failing to be checked by a user to be displayed.

Accordingly, embodiments of the present invention provide variouseffects and/or features.

First of all, the present invention provides a mobile terminal andcontrolling method thereof, by which user's convenience can be enhanced.

Secondly, the present invention provides a mobile terminal andcontrolling method thereof, by which an image related to a counterpartcan be displayed despite that a profile photo of the counterpart is notregistered in a phonebook.

Thirdly, the present invention provides a mobile terminal andcontrolling method thereof, by which a new image can be displayed inresponse to each occurrence of an event.

It will be appreciated by those skilled in the art that the presentinvention can be specified into other form(s) without departing from thespirit or scope of the inventions.

In addition, the above-described methods can be implemented in a programrecorded medium as processor-readable codes. The processor-readablemedia may include all kinds of recording devices in which data readableby a processor are stored. The processor-readable media may include ROM,RAM, CD-ROM, magnetic tapes, floppy discs, optical data storage devices,and the like for example and also include carrier-wave typeimplementations (e.g., transmission via Internet).

It will be appreciated by those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

Accordingly, embodiments of the present invention are directed to amobile terminal and controlling method thereof that substantiallyobviate one or more problems due to limitations and disadvantages of therelated art.

An object of the present invention is to provide a mobile terminal andcontrolling method thereof, by which user's convenience can be enhanced.

In particular, one object of the present invention is to provide amobile terminal and controlling method thereof, by which an imagerelated to a counterpart can be displayed despite that a profile photoof the counterpart is not registered in a phonebook.

Another object of the present invention is to provide a mobile terminaland controlling method thereof, by which a new image can be displayed inresponse to each occurrence of an event.

Additional advantages, objects, and features of the invention will beset forth in the disclosure herein as well as the accompanying drawings.Such aspects may also be appreciated by those skilled in the art basedon the disclosure herein.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, amobile terminal according to the present invention may include a displayunit configured to display information, a wireless communication unitconfigured to communicate with an external server that stores firstimage data and to communicate with a counterpart terminal, a memory tostore a second image data, and a controller, in response to an eventtriggered by the counterpart terminal, to extract an image data relatedto a counterpart from one of the first image data and the second imagedata, and the controller to output the extracted image data on a portionof the display unit to notify an occurrence of the event.

In another aspect of the present invention, as embodied and broadlydescribed herein, a method of controlling a mobile terminal according tothe present invention may include recognizing an event triggered by acounterpart terminal, extracting an image data related to a counterpartfrom one of first image data in an external server and second image datain a memory, and outputting the extracted image data at a portion of adisplay unit to notify an occurrence of the event.

Effects obtainable from the present invention may be non-limited by theabove mentioned effect. And, other unmentioned effects can be clearlyunderstood from the following description by those having ordinary skillin the technical field to which the present invention pertains.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

Any reference in this specification to “one embodiment,” “anembodiment,” “example embodiment,” etc., means that a particularfeature, structure, or characteristic described in connection with theembodiment is included in at least one embodiment of the invention. Theappearances of such phrases in various places in the specification arenot necessarily all referring to the same embodiment. Further, when aparticular feature, structure, or characteristic is described inconnection with any embodiment, it is submitted that it is within thepurview of one skilled in the art to affect such feature, structure, orcharacteristic in connection with other ones of the embodiments.

Although embodiments have been described with reference to a number ofillustrative embodiments thereof, it should be understood that numerousother modifications and embodiments can be devised by those skilled inthe art that will fall within the spirit and scope of the principles ofthis disclosure. More particularly, various variations and modificationsare possible in the component parts and/or arrangements of the subjectcombination arrangement within the scope of the disclosure, the drawingsand the appended claims. In addition to variations and modifications inthe component parts and/or arrangements, alternative uses will also beapparent to those skilled in the art.

What is claimed is:
 1. A method for controlling a mobile terminal, themethod comprising: communicating with at least one server; recognizingan event triggered by a counterpart terminal, wherein the event includesa case that an incoming call is received from the counterpart terminal;in response to recognizing the event, automatically extracting imagedata related to the counterpart terminal from a messenger server or anSNS (social networking service) server among the at least one server,wherein the image data corresponds to a profile photo registered in themessenger server or the SNS server; displaying all of a first option foranswering the incoming call, a second option for declining the incomingcall, the image data in order to announce that the event has occurred;displaying an object for indicating that the image data is extractedfrom the SNS server; accessing an account of the counterpart terminal inthe SNS server in response to touching the object; and setting the imagedata as a background of the event in response to receiving a prescribeduser input.
 2. The method of claim 1, wherein the mobile terminalaccesses the SNS server related to the counterpart terminal withreceiving the incoming call from the counterpart terminal.
 3. The methodof claim 1, wherein the object is displayed on the image data, furtherthe image data occupies a larger portion than each portion of thedisplayed first option and the second option.
 4. The method of claim 1,further comprising: displaying an ID for using the SNS server with acontent of a message recently transceived with the counterpart terminal.5. The method of claim 1, wherein the displayed object is linked tolocation information related to the image data stored in the messengerserver or the SNS server.
 6. A mobile terminal, the mobile terminalcomprising: a network interface configured to communicate with at leastone server; and a controller configured to: recognize an event triggeredby a counterpart terminal, wherein the event includes a case that anincoming call is received from the counterpart terminal, in response torecognize the event, automatically extract image data related to thecounterpart terminal from a messenger server or an SNS (socialnetworking service) server among the at least one server, wherein theimage data corresponds to a profile photo registered in the messengerserver or the SNS server, control a display module to display all of afirst option for answering the incoming call, a second option fordeclining the incoming call, and the image data in order to announcethat the event has occurred, control the display module to display anobject for indicating that the image data is extracted from the SNSserver; access an account of the counterpart terminal in the SNS serverin response to touching the object, and set the image data as abackground of the event in response to receiving a prescribed userinput.
 7. The mobile terminal of claim 6, wherein the mobile terminalaccesses the SNS server related to the counterpart terminal withreceiving the incoming call from the counterpart terminal.
 8. The mobileterminal of claim 6, wherein the object is displayed on the image data,further the image data occupies a larger portion than each portion ofthe displayed first option and the second option.
 9. The mobile terminalof claim 6, wherein the controller is further configured to control thedisplay module to display an ID for using the SNS server with a contentof a message recently transceived with the counterpart terminal.
 10. Themobile terminal of claim 6, wherein the displayed object is linked tolocation information related to the image data stored in the messengerserver or the SNS server.